A Convergence Theory for Saddle Functions
نویسندگان
چکیده
We develop a convergence theory called epi/hypo-convergence, for bivariate functions that essentially implies the convergence of their saddle points. We study the properties of this limiting process in particular. We characterize the limit functions associated to any collection of bivariate functions and obtain a compactness theorem for the space of saddle functions. Even when restricted to the univariate case, the results generalize those known for epi-convergence. In particular, we show that the analysis of the convergence process via Yosida approximates must not be restricted to the convex case.
منابع مشابه
Generalized iterative methods for solving double saddle point problem
In this paper, we develop some stationary iterative schemes in block forms for solving double saddle point problem. To this end, we first generalize the Jacobi iterative method and study its convergence under certain condition. Moreover, using a relaxation parameter, the weighted version of the Jacobi method together with its convergence analysis are considered. Furthermore, we extend a method...
متن کاملTheory of block-pulse functions in numerical solution of Fredholm integral equations of the second kind
Recently, the block-pulse functions (BPFs) are used in solving electromagnetic scattering problem, which are modeled as linear Fredholm integral equations (FIEs) of the second kind. But the theoretical aspect of this method has not fully investigated yet. In this article, in addition to presenting a new approach for solving FIE of the second kind, the theory of both methods is investigated as a...
متن کاملConvergence Properties of Hermitian and Skew Hermitian Splitting Methods
In this paper we consider the solutions of linear systems of saddle point problems. By using the spectrum of a quadratic matrix polynomial, we study the eigenvalues of the iterative matrix of the Hermitian and skew Hermitian splitting method.
متن کاملSaddle-Point Dynamics: Conditions for Asymptotic Stability of Saddle Points
This paper considers continuously differentiable functions of two vector variables that have (possibly a continuum of) min-max saddle points. We study the asymptotic convergence properties of the associated saddle-point dynamics (gradient-descent in the first variable and gradientascent in the second one). We identify a suite of complementary conditions under which the set of saddle points is a...
متن کاملEscaping From Saddle Points - Online Stochastic Gradient for Tensor Decomposition
We analyze stochastic gradient descent for optimizing non-convex functions. In many cases for non-convex functions the goal is to find a reasonable local minimum, and the main concern is that gradient updates are trapped in saddle points. In this paper we identify strict saddle property for non-convex problem that allows for efficient optimization. Using this property we show that from an arbit...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008